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” The Prediction es, eee Association Hierarchies from uaa Are ietes 


° ert Silverstein, sea a as of Rhode Islana” 


\ 
Because of the importance of the concept of association in the history of 


* psychology, the use of free association norms to describe verbal materials has 


enjoyed great popularity. ie the more recent uses of such norms, one of 


the most important has been an index of the. "relatedness" of words. Several 


theoris ts2 


, 


have argued that the relatedness or meaningful Similarity between 
words depends upon the degree to which they are associatively connected. This ¢ 
argument is based upon the assumption that "the distribution of responses to any 


free “association stimlus forms the associative meaning of the stimulus word and 
‘ if : ; 
thus an associative concept named by the word.''> The most obvious way of measur- | 


ing the aseciative-relatedness. of two. words is by the relative frequency with 
which they evoke each other in cultural}. free association norms. Deese* has 


also used this procedurg to obtain a measure of the total relatedness_of a list \ 


of words: interitein associative strength, A more complex approach to measuring eC 


— 


associative- relatedness is that of assessing the degree to which two or more. 


5 


words produce common associates. In all tases, the measures are.based upoii the 


si mais with which particular stimulus words yield particular associations. 
| Ca 
The importance of the concept of associative relatedness bies in its wide- 


spread use as an independent variable in jartois problems of verbal behavior. 
‘It has been used to predict: performance in paired-associate*learning,® inter- , ow 


Sy . 
ference and forpetting,’ positive transfer in verbal learning,” clustering in 


free. recall, 9 associational analyses: of concept, formation, " semantic. ‘generali- 


zation, 11. 


a 
“Sequential comtingencics in omitted engech, 12 and the effects ‘of 
\ 
linguistic context on the production of speech. 13 ‘The tacit assumption in all 


the_above examples has been that the "distribution, of responses taken one per 


\ 
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' eral use of averaged values to represent individual verbal processes has come in 


wae Te 
: _posittiol by a sample of Ss would then comprise the hierarchy of response strengths A 


et | 0m 
individual per stimulus word °'. .is characteristic of the distribution of asso- - 
Ciations at different times ine any one rcunisentative individual. nl Perhaps: 
because such an assumption appears to be so “reasonable; ‘relevant data are rare. 


ieee, the assumption has not gone ‘tompietely eepeieanee 15 Indeed, the al ; 


for some very heavy criticism during tHe course of the recent one- -trial eaming 
controverfy 16 for these reasons, a direct comparison of frequencies obtained on 
cultural association noms to response stren in eae. association hierare 
chies is badly needed. ad a 

There are two experimental designs which may be used to generate individual 
hierarchies of association. The first involves having S respond to each stimulus’ 
repeatedly during'a specified/periond of time. This may be called the production 
method because of its resemblance to Noble rg? procedure for measuring meaningful- 
ness. Hére, Ss are instructed to give a sequence of different faenisis to each 
stimulus, so that the strength of any one response etmnot be indexed by how often . 
S repeats it. Instead, the serial order in which the response is given must be 


used to measure its strength» The response given most frequently in each serial 


\ 


en a given stimulus. The ee. * procedure involves testing each S for the entire 


ca 


list of stimuli on several different occasions. This. may be called the independent iy 


repetitions methqd. In this method, the average frequency of repetition of a , 
response would be used to index its strength in the ayprage individual hierarchy. 

ek | 

There are difficulties inherent in each of these procedures, but those * 


oe d with the independent repetitions method seem less serious for the pur- 


*pose of arison with cultural frequency norms. The degree to which responses 


d : | J = 
obtained by the independent repetitions method are actually independent is quite ©. 
ry 


too \ 
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difficult to assess, since S's ace for prior responses’ cannot be eliminated 

no matter what tite intervals between tests are used. In addition, this method 

involves the problem of contextual determination of responses « That B55 the | 
immediately prior items on the list can influence the sid to a particular ¥ 
stimulus. 18 However , “the absolute independence of responses is not critical | 
since the important comparison Would be that between associations of different 

cultural ‘frequencies ; and their independences should not differ ines they also 


differ in response strenpth, Similarly, the saved tive strengt of a response 


should determine its ability to withstand the effects of shifting context from a 
test to test. For this reason, the best pfocedure would be to re. responses 
of differing cultural frequencies with regard to the frequency at they are . ‘ 

* 


repeated after h ving been been given on the ELiot trial of an inde t repetitions | “ie 


ila 


must be noted 


a 


With Rigs to the difficulties of the ead ai “ooagea) i 


that only order of response- icidediek can be Sbtained and that’ this fis arf indirect 


2 P 


measure of assotiative strength. This difficulty is slightly mitigated by the 
well substantiated finding that cultural frequency is highly corteated with 


ic ina reaction time.19 ,\ more seribus problem lies in the 'scorer's inabil- 
4, 
ity to eliminate associative chains from the data, which makes later associations 
® ; é | : 
| 


given to a stimulus likely to be associates to prior responses. 
Some evidence from the production method Suggests that sivhral Frequencies 
do wimaltct individual association strengths . “Cofer a hae Ss give associations | 
to e stimuli from the Kent- Rosanoff?) norms, and pooled the frequencies of all 
responses given to each stimulus. He found high agreement. between the ‘ranks of + 
_ his froquencies: and those obtained by Kent and Rosanoff. However, since ok 


did not consider , ae serial position of the responses ‘he obtained, his data are 


not relevant to the ‘problem of comparability between group and individual asso- 


* 
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clatigns hierarchies. kosen and Russel 122 obtained two successive asspciations 
for 100 of the Kent-Rosanoff_ stimaii and found: (a) that the mean cultural 

5 oy : ey t 
“frequencies of first associations were substantially higher than those of the ~ 


s 


second associations and (b) that for no response pair was the second response's 
cultural frequency: higher than that of the first response. Garskof£23 gave two 
independent groups of Ss either a suis or a continuous association test for 20 | 
words. ‘The average order of emission of associations correlatéd with frequency of 
single-associations betweens.52 and .94, with a median of jae x a 
Indirect evidence that cultural frequencies and production-method hierarchies 
are similar comes from several sources. First, Garskoff and Marshall24 found | : 
that measures of the associative overlaps of 140 words obtained from single | 
asso¢iations and from the production method were correleated .76. They also 
found, however, that the single-association measure of overlap was more sensitive 
to the degree of diréct associ ation betwen pairs of words. Similarly, the 
averlap anebeictents between pairs of words an various semantic categories obtained 
by Laffal and Feldman?> from’ single\and eanbinuots word associations correlated .88. 
Finally, it should be noted that the rime? of different responses obtained from the 
production method correlates highly with the number of Ss able to give a single 
"association. 76 - | , a 
There is very little: evidence pepardat the relation of cultral association 


\ 


frequencies to individual hierarchies obtained by the independent 
27 


repetitions 


method. Laffal 


t 


has found that, in the clinical setting, Ss who! failed to 


. ‘ 


repeat an association to 2 stimulus were more likely ‘to have given a response 


that had strong competitors on the cultural namms than were Ss who did repeat -an 
\ 


| - - 


a. 


assocbation. The present study was designed to obtain more systematic information’, 


conceming this relation by presenting Ss a list of words three times, in dif- 
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ferent random orders , and calculating the frequency with which various associations | 


given on the first trial were repated on subsequent trials. It was hypothesized 
that’ this frequency would increase as the cultural fiigiac) of the association 
increased. Different groups of Ss were given lists of high and’ low frequency 
words. It was predicted | that the ‘High- F words would produce “a Higher level of 
repetition of associates, samice associations to Hith-F words tend to more ” 
commmality than do associations to Low-F words. Separate analyses were made of ~ 
the repetitions to cultural-frequency tunction for paradigmatic (same ‘form class) 
and syntagmatic. (different form class) associates. Since patadi gmatic associates 
‘~ are presumed to be less dependent upon particular linguistic contexts ,28 it was 
hypothesized that they would be disturbed less by shifts in the items preceeding 


a stimulus word; and hence both be repeated more often than syntagmatic asso- 


ciates and show a clearer relation between repetition level and cultural frequency. 


5 
> 


Me thod 
Subjects and apparatus. The Ss were 96 college students from an intro- 
ductory psychology course. Half randomly were assigned to each of two list- 
conditjons : high frequency and low frequency. The Ss were run in smali groups 


ranging in number from 1 to oe with a mean of 3.4. A*Bell and Howe 11 Robomatic 


slidd projector with automatic timer showed eakth word for 5S seconds on a milk- 


s 


\, glass screen. 
e s 


Materials. Twa lists of two-syllable nouns were used, one at each frequency 


‘level. Each list contained 20 words . The L count? for the High-F nouns ranged 


‘Grom 1000 ob 5500 occurrences per million, while for the Low-F nouns it daniel 
from 10 to if occurrences. Familiarity, interitem associative strength:and rated 
meaningfulness covaried with feqiiency , but the lists were equated for formal 


. similarity. Association noms for these words had been obtained previously from 
: ; 
ee ¢ w 
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‘1000 Ss at tHe University of Califomia. es 


PSD) 
’ ‘ Z 


Procedure. Both groups of Ss were shown their list for 3 trials. The 
intertrial interval was 25 seconds. All Ss: were instructed that they were to 
participate in an experiment eect the consist@gcy of associations. They 
were told to cover each association given to a word béfore they saw the next 
‘stimOlus word, and that the list of words would be gg ina different order 
on each presentation. _ They were asked not to try to recall previous associ@tions, 
by Simply to give the first word that came to mind regardless of what it was. 
Four different random orders of presentation “ used for each of the lists. 

In each treatment group, 12 Ss received each of the orders first. Four Ss from 
the Low-F condition and two from the High-F condition were discarded because 


they had been recently in another verbal leaming experiment. 
( 


Results 

Repregentativeness of sample. Since the Califomia association norms were 
used as the frequency values for predicting probability of repetition in this 
experiment, a comparison was made between the first esemciatigns given by* the 
present sample of Ss and the associations given by the 1000 Ss in the California 
sample. Table 1 sfows, for each list, the percentage of responses that fall ., 4 
in each of the ftrst $ Califomia ranks, both for the present sample and for the © 
larger, California stmple. It can be seen that the distributions according to s 
~~yanks are roughly sitet in the two cases, and that the major differences come 
from the present sample of Ss giving a greater percentage of California-norm pri- 
mary responses than did the Ss from whom those norms were obtained. This differ- 
ence may be expected on the basis of the smaller sample used in the present study; 
and the fact that the Ss in the California sample were ascochating to a substan- 
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tially longer list. A specific comparison was made of the ‘five responses given 
most frequently by both samples to each of the 40 stimulus words. The primary 
response given by the Califomia sample for 31 of the stimuli was also the primary 
for the present sample; for 5 of the stints the iene plane was he 
secondary response given in this experiment, In only 80 instances of a possible 
400 did any word appear in the first five ranks of one sample, but not the other. 
‘In sa eee sample of Ss seems quite representative of the larger one. 


ability of: repetition ‘and cultural frequency. Each association given 


* 


on the first trial of this experiment was first classified according to do aa 
it fell in one of the first five frequency ranks of the Cali fomia norms, in 
ranks greater than five, or was paiodmnerstis. Next, the associations were 
assigned to one -of three repetition catepories: ‘ (1) repeated on both subsequent | 
trials, (2) repeated on qne of the subsequent trials, (3) repeated on neither 
of the subsequent trials. The’ percentage of responses from each of ‘the seven 
cuitural- frequency categories that were rec ited twice, once, and not at all was 
then calculated. Table 2A presents these data for the pooled responses from 

both lists, along with the number of responses obtained at each frequency level. 


| Meee a 


Insert Table e8 about out here 

It is apparent that the probability of ‘obtaining two repetitions inensawes 
directly with, the relative frequency of the association, while the probability 
of obtaining ‘no repetitions increases inversely with repative frequency . The 
probability of chtoindns one repetition does not vary in any systematic nee 
Thtre appear to be five discrete cateyories (with ranks 3, 4, and 5 forming a 
Saat eatery? SO far" as probability of pepebe nie is concemed. (Chi-square 
tests were performed on the separate digupinations obtained from the high and 


: ae lists to test the hypothesis that the cultural frequency of the 
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responses did not chatige the distributions across the three repetition. categories. 
The expected values used for these tests were’ calculated by taking the. percentage 


% of all responses to aglist that. fell in each of the repefition categories and 


\ 


multiplying it by the nunber of responses at each cultural-frequency rank.’ The 


values obtained were 101.29 and 71.51 for the’High-F and Low-F lists, respectively. 
(df=20, p~.001, for both). | "5 e 
The first associations given were also classified into seven percentages 
m of olute cultural frequency in order to see whether probability of ropetitica 
is more sensitive to this variable than to relative frequency (i.ee, ranks) .>! 


The distribution of repetitions, however, was Subeeantiatdy the same as that using 


ranks. (See table 2B.) Again, five discrete categories were found: over 25.0%, 


5.08, 24.98, 0.68-4.98, 0.28-0.58, and idiosyncratic. y 


To further cousehits the respective infuences on probability of repetition | 
¢ 


‘of absolute and relative frequency, an index of repetition was calculated for: 


the five primary associates in each list with the lowest absolute frequencies, 
five rank-3 associates in each List with matching absolute frequencies, and the 
five primary associates with the highest absolute frequencies, and the five 
primary associates with the highest absolute frequencies. The index of repetition 
(IR) represents the total number of times that.an associate is repeated over 
the 2nd and 3rd trial divided by the total ruses of opportunities. Table 3 
presents the means for IR and cultural frequency (CF) for these 30 associations. 
; Insert Table 3 about here_ , a 

The most common primary responses were repeated more often than e least common — 
“primaries ( t=1.75, df 19, -05<p¢.10), while the IR for primaries and seeonee 
aries of matched absolute frequency did not substantially differ (t 1). 4 

High vs low frequency lists. The hypothesis that high frequency stimuli 
would produce greater associative cesentiion an low frequency stimuli was not- 


14) - @ 
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confirmed, despite the fact that the high frequency list-did yield far greater 


commonality of ‘responses (see table 4). Overall indices of repetition for the’ 


° 


High-F and Low-F lists, respectively, were 42.1% and 51.7%. The ‘Teason for 
this Jack of difference may be observed in table 4, ital displays the IR values 
across frequency ranks od the two Se The idiosyncratic responses given ” 


"to the Low-F simi are » tepeated substantially more often ‘than thdseggiven to 


the High-F r stimuli. . In fact, it appears that the High- 4 list produces a ‘generally 
stetper sc relating cultural sl and Secu of repetition. How--: 


ever, a sdvsriuirs test of the assumption that the two distributions do not / 
‘ 4 s 


. . & : 
differ yielded a value of anly 6.29 Ldge13, p.>.90). It should also be noted = 


that the secondary responses given to the Low-F stimuli produce an IR that re- Sg 


semblies that for the primaries, while the secondary responses given to the High- P 


_ stimuli produce an IR simitar to that for ranks 3, 4, and S. This difference 


‘or the associate occurs contiguously to the stimulus in sentence positions. ; a 


cannot be atcounted .for by the fact that the absolute frequencies of primary 

ae secondary responses are Slightly more stir in the Low-F list, since replacs: 

ing frequency ranks with absolute Peaencies: does not eliminate the difference. 
Patadigmatic vs syntagmatic associates. Fach association given to a stimu- 

lus word was classified by two judges as paradigmatic, syntagmatic, or clang. 

The basit conceptual distinction between the first two categories is ‘that of 

whether the associate is substitutable for the ataimabus in sentence positions, 


Usually, but not always, the substitutability (paradigmatic) criterion is met 


when stimlus and response are of the same grammatical form class and.the conti- 


‘guity (syntagmatic) criterion is met when they are of different form classes. 


In many cases both criteria may be fulfilled, in which case (if the contiguity 


& 


is in S-R direction) the association was classed as syntagmatic. In 25 doubtful 


« Ad * a 


~~ 


= 


? 
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Wases. 10 add tional Ss were asked whether the S-R sequences were ones which 
actually occur in the English language . th only two cases was there less than 
7/10 agreement , and these wety eliminated, . | 

Cont rary to the hypothesis, the overall IR was slightly (but not reliably) 
oe for the paradi gnatic wcetetien ease vs 52.8%. Nor do the paradigmatic 
associates show. gny trend toward a steeper function relating IR to frequency 
rank. A chi-square fest of the hypothesis that the two distributions do not 


differ yielded a value of 4 47 (df=13, p +95). ° ” 


- The percentage of syntagmatic responses obtained on the first trial for the 


3¢ though Slightly 
\ ad 


higher. Unlike adjectives ,, Where he found lower percentages of syntagmatit 


f 
two lists is beugity comparable with that obtained by Deese, 


responses with aEe frequency » Deese found no relation between i 
and percent-syntagmatic associates for nouns. In the present study, the High-F 
nouns have a somewhat higher percentage of syntagmatic responses (36.9% vs 26.5%) 
but this difference is not reliable (t=l.21, p>.20). The reason for this 
difference seems to be that 7 of the 20 High-F nouns used may also be used as 
other form classes (i.e. verb or adjective), while only 2 of the Low-F nouns 
have such dual function, fenainig included within the critcrion of syntagmatic 
response any. associate which shows both substitution and contiguity characteris- 
tics, one would expect these dual fimction words to yield greater syntagmatic, 
nerentaeak: which, indeed; they do. 

* Discussion ‘ 

The major finding of the present experiment is that cultural free association 
norms do reflect individual association hierarchies, as measured by probability of 
repeating an associate. It appears, however, that the association strengths ob- 
tained from the single assaciations of a large number of subjects yield a finer 
gradation than those obtained from probability of repetition within subjects. 

: a 
ered 
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This fact is in accord with some recent data showing that weaker cultural 
associations may produce as speedy direct and mediated ele aacneiate learming 
as do stronger cultural associations. *9 Perhaps cultural free association noms - 
produce a spurious fineness of 'pradatifn in associative strength. Stoms,» 7 
however, has Suggested an altemative ‘interpretation: that "Pecency”" operated to 
. tenooneptly sprengthen weaker: associations. He showed that if Ss are given a list 
of nee to reéall prior to an associatfomask, that the words on the list be- 
come more likely to appear on the association protocols. It would be useful to. 
sac ge if the gradation in probability of recal} could be sharpened by using very 
* long intervals between trials. a 3 
The present data omeey suggest that absolute cultural frequencies are 
wo “nore reliable indices of ifitrasubject association strengths than are cultural- 
frequency ranks. Primary and rank-3 responses of equal. absolute frequency 
showed equivalent IR values, while those same primary responses were repeated 
- 12.3% less often than more comnneatly given primaries. Ft is possible that some 
other factor than absolute associative frequency was responsible ee this differ- 
yj ence. For example, primary associates pf greater frequency have greater super- 
iority over their nearest cometiter thgn primary associates of lower frequency. 
Also, more common primaries might be more likely to occur to stimli that produce 


a smaller total number of different associations, or to stimuli Sat produce more : | 


associations that are related to the primary associate. Although 1t-i5 not 
possible to select among these altermatives with the‘small number of stimuli used 
in this experiment, it would seem preferable to use the frequencies rather than 
the ion.3 “rom cultural association noms for diagnostic purposes. 
oe ovsrito finding the expected larger number of primary~responses and smaller 
number of idiosyncratic responses with the High-F list than with the Low-F list, 
no overall difference was found in the level of repetition for the two lists. 
13 : a 
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It was shown that this was main}) the mesult of a sipinticn gher repetition 

level for idiosyncratic responses in the Lew list. sono that this. 
Poenemencn te the result of idiosymcratic responses sella tini / 


things cas ffequent ate infrequent stimuli. For one thing, High-F words are 


Likely to have been aneeienced in a wider. vitiety ofpliigustic contexts than 
have aise words, for any one individual. But the dominant linguistic context 
for Loy-F words should be more variable between individuals. Thus, an idiosyncra- 
tic response to a High-F stimulus may represent. the influence of some transient 
feature of the momentary context, while an idiosyncra@ic response to a Low-F \ 
stimulus may be a truly strong associate: for that individual which he does not 
share with other individuals. For these same jensen, one would expect idio- 7 ; 
syncratic responses to High-F stimuli to be subject to a greater number of compet- 
ing seuaciatieis than are faboeynemitie nesponses to toe gtimili. Such an inter- 
pretatioh is supported by the fact that High-F words yield a greater number of 
different associations per person tne production method, despite showing 
less associative variety in single-respdnse hierarchies. It is thus quite 
possible that cultural association norms give a somewhat inaccurate picture of 
the individual response hierarchies of extremely unfamiliar words. ' 
It is also possible that the repetition level for more common associates of 
the High-F list was depressed by a general tendency to inhibit repetition of a 
response to successive stimuli. Thus, S has just said "man'' to the stimlus 
"doctor,'' he may inhibit saying it again if "woman'' is the next stimulus. The 
overlap in associative hierarchies is much greater for Hi gh-F words than for 
Low-F words, so it is possible that a reliable difference between JR values for 
dies tives Niwa, Wetitel have een Shienined 28 they had been whee dnto-aswiigie taste 
The failure to find either a difference in overall level of repetition or 


a difference in the sharpness of the frequency-IR function between the paradig- 


_ ‘ 14 | 
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r) 
matic and syntagmatic associations is truly puzzling. There arg two general 
possibilities open as an explanation. Either the effect of shifting the linguis- 


tic context from trial’to trial was minimal, or else syntagmatic associates have 


some special way of resisting such contextual shifts. The former Alternative 


could be investigated by introducing more radical contextual shifts from test 
to test and noting whether differences between paradigmatic and syntagmatic 


associations appear. ‘ 


| Summary : | 
Ss were given three successive free-association tests to a list of 20 stim- 
‘ ia 
lus words of either high or low frequency. The index of repetition (IR) of 
associations was analyzed as a function of their commonness on culturdl ‘associa- \ 


\ 
tion norms. In general, it was found Rat cultural frequencies do predict IR of 


associations, and hence they represent individual association hierarchies. The 


only difference found between Ik for High-F and Low-F lists was a higher value , 
; i 
for aa lay in the Low-F case. No differences in IR values was 


found between paradigmatic and syntagmatic associations. 
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